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Activity or spin patterns on random scale-free network are studied by mean field analysis and 
computer simulations. These activity patterns evolve in time according to local majority-rule dy- 
namics which is implemented using (i) parallel or synchronous updating and (ii) random sequential 
or asynchronous updating. Our mean-field calculations predict that the relaxation processes of dis- 
ordered activity patterns become much more efficient as the scaling exponent 7 of the scale-free 
degree distribution changes from 7 > 5/2 to 7 < 5/2. For 7 > 5/2, the corresponding decay times 
increase as ln(JV) with increasing network size N whereas they are independent of TV for 7 < 5/2. 
In order to check these mean field predictions, extensive simulations of the pattern dynamics have 
been performed using two different ensembles of random scale-free networks: (A) multi-networks as 
generated by the configuration method, which typically leads to many self-connections and multi- 
ple edges, and (B) simple-networks without self-connections and multiple edges. We find that the 
mean field predictions are confirmed (i) for random sequential updating of multi-networks and (ii) 
for both parallel and random sequential updating of simple- networks with 7 = 2.25 and 7 = 2.6. 
For 7 = 2.4, the data for the simple-networks seem to be consistent with mean field theory as well 
whereas we cannot draw a definite conclusion from the simulation data for the multi-networks. The 
latter difficulty can be understood in terms of an effective scaling exponent y e ff = 7eff(7, iV) for 
mult i- networks. This effective exponent is determined by removing all self-connections and multiple 
edges; it satisfies y e s > 7 and decreases towards 7 with increasing network size N. For 7 = 2.4, we 
find 7cff £ 5/2 up to N = 2 17 . 

PACS numbers: 89.75.Fb, 87.23. Gc, 05.70.Ln 

I. INTRODUCTION 

Both the overall topology and the local structure of complex networks influence the efficiency as well as the robust- 
ness or sensitivity of dynamic processes occurring on these networks. Furthermore, the local network architecture 
often evolves with time in order to optimize certain network properties. This interplay of structure and dynamics 
eventually leads to the formation of highly optimized network topologies for specific dynamic processes. 

Understanding the underlying mechanism for the optimization of networks via evolution is an important but chal- 
lenging problem of current network research. There are two major difficulties. First, the optimization of different 
dynamic processes may require different network architectures. For example, we would not be surprised to find out 
that the architectures of car traffic networks and electronic networks on micro-processor chips are rather different. 
Therefore in order to study network evolution, we should focus on a particular dynamic process. Second, the evolution 
process is usually governed by some more or less complex growth rules which are coupled in some unknown way to 
the dynamic process under consideration. 

In this article, we use a somewhat different approach and study the influence of network architectures on relatively 
simple dynamic processes. By performing such an analysis, we are able to identify those aspects of the network 
structure that are important for the dynamic processes. Such a theoretical investigation should also be useful to 
analyze the available empirical data about complex networks in terms of optimization to design improved network 
structrues for a particular dynamic process. 

A network can be represented by a graph of vertices (nodes) and edges (links). Each edge of the network connects 
two vertices of the network. The vertex degree k is equal to the total number of edges that are connected to this 
vertex. Recent structural studies on complex networks [l], 0, 0] show that the topology of real-world networks often 
has the so-called scale-free property This means that the total number N(k) of vertices with degree k scales 
with k as a power-law, N(k) ~ k~ 7 , with the decay or scaling exponent 7. Such a power-law scaling of the degree 
distribution appears if the network grows via a preferential attachment mechanism [4| . It is also plausible that the 
scale-free scaling is a result of network evolution and optimization, but so far there are only a few theoretical studies 
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that have addressed this issue (e.g., Refs. 0, H, 0, [!])• 

In the following, we will consider the influence of scale-free random networks on the activity patterns of binary or 
Ising-like variables which are governed by local majority-rule dynamics. We focus on scale-free networks because they 
are abundant in our biosphere. We study local majority-rule dynamics because it is simple and frequently encountered 
in the real world, and also because it can be readily extended to a large class of more complicated dynamic processes. 

We perform both analytical mean-field calculations and extensive numerical simulations on these model systems. 
Our mean-field calculations predict that, when the scaling exponent 7 of the substrate network changes from 7 > 5/2 
to 7 < 5/2, a qualitative improvement in the efficiency of the dynamic process can be achieved, namely the typical 
relaxation time changes from being proportional to ln(iV) to being independent of N, where N is the total number of 
nodes in the network. In the simulations, we consider two different methods to generate ensembles of random scale-free 
networks: (i) multi-networks, which are generated using the so-called configuration model and contain some multiple 
edges and self-connections; and (ii) simple- networks, which involve some random reshuffling of edges and do not 
contain any multiple edges or self-connections. Our mean-field results are quantitatively confirmed by the simulations 
for simple-networks whereas the behavior on multi-networks exhibits strong finite-size corrections arising from the 
presence of multiple edges and self-connections. We use both parallel (or synchronous) and random sequential (or 
asynchronous) updating and find that both updating methods give very similar results for simple-networks whereas 
they lead to somewhat different results for multi-networks. The present study extends our previous work in Ref. Q 
in which we focussed on parallel updating for multi-networks. 

Our mean-field theory can be extended to related dynamic processes. Instead of Ising-like variables, we have studied 
Potts-like variables which can attain three or more different states. We have also considered more complex dynamic 
rules for which one applies the local majority rule to each spin variable with a certain probaility say P, and another 
dynamic rule such as random Boolean dynamics with probability 1 — V . Likewise, we have extended our analysis to 
majority rule dynamics on directed networks and to Hopfield models on scale-free networks Q. In all cases, the mean- 
field theorey predicts that the dynamic behavior changes qualitatively as one crosses the boundary value 7 = 5/2. It 
is of interest to note that many scale-free networks are characterized by scaling exponents 7 which fall into the narrow 
range 2<7<5/2as observed in Ref. Indeed, table II of Ref. [l[ contains a list of ten scale- free networks with 
2 < 7 < 5/2, one with 7 = 2.5, and only three with 2.5 < 7 < 3. 

This paper is organized as follows. We first describe our model system in more detail in Sec. [Ill Then our mean-field 
analysis is presented in Sec. IIIII Simulation results of local majority-rule dynamics are discussed in Sec. lIVI for random 
multi-networks with multiple edges and self-connections, and in Sec. |V] for random simple-networks without any such 
connections. The simulation results for simple-networks are in complete agreement with the mean field predictions 
whereas we find only partial agreement between the simulation results for multi-networks and mean field theory. We 
then argue in Sec. IVII that the remaining discrepancies can be understood if one characterizes the multi-networks by 
an effective ./V-dependent scaling exponent 7 ff > 7. Finally we conclude our work in Sec. IVIll with a summary and 
an outlook on related problems. 

II. SCALE-FREE NETWORKS AND MAJORITY-RULE DYNAMICS 

In the following, we study local majority-rule dynamics on scale-free random networks. In order to do so, we first 
describe the ensemble of random networks used in our study and then define the dynamic rules. 

A. Scale-free degree sequences 

We consider an ensemble of random networks. Each network consists of N vertices and edges that connect pairs of 
vertices. Each vertex i with i = 1, 2, . . . , JV is connected to fcj > ko edges where kg represents the minimal value of the 
vertex degrees ki. As in Ref. 0], we will focus on fco > 2 for which the network has no 'dangling ends' and consists of 
many cycles. We consider an ensemble of random networks that provide realizations of the degree distribution 

P(fci) cx kp for h > k (1) 

which is characterized by a power-law decay with scaling exponent 7. In order to generate such a network ensemble, 
we treat the vertex deg r6G ki clS 3i random integer variable governed by the degree distribution |T|) . 

In order to generate a single random network with N vertices, we used the following algorithm for generating a 
vertex degree sequence consisting of N vertex degrees fej. We successively draw a random integer ki according to the 
degree distribution (|TJ) . If the drawn vertex degree satisfies ki < N — 1, we add it to our degree sequence. Otherwise, 
we discard it and draw another ki until we obtain one that fulfills this inequality. Thus, we use the upper cut-off 
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fcmax = N —1 for the vertex degree sequences. This procedure differs slightly from the one that we used previously in 
@ . In the latter study, we did not discard and redraw the vertex degrees fcj with fcj > N — 1 but replaced them by 
fcj = N — 1. This procedure has the disadvantage that the actual degree distribution corresponding to the generated 
vertex degree sequence may develop a small peak at fcj = N — 1 for sufficiently small network size N. The new 
algorithm used here avoids this artefact. The choice for the upper cut-off fcmax = N — 1 is rather natural since this 
is the maximal vertex degree for a network without multiple edges and self-connections. Note that we do not use an 
upper cutoff k^L ~ N 1 / 2 as in Refs. [Hill. 

(2) l 

For analytical estimates, it will be useful to define a second upper cut-off, fcmax = kgNf- 1 , for the vertex degree. 
The latter cut-off was introduced in [l3[ and rederived by different arguments in [?|, see Appendix A. The effective 
upper cut-off for the generated vertex degree sequence is then given by 

fcmax = min(fc« x , fc( n 2 > x ) = fcoiV^T (2) 

sr > $-v/b-*) ) 

sequence is well approximated by 



where the last equality applies to N > fc 7 , and the actual vertex degree distribution for the generated degree 



P(ki)=kp/A for fc <fc,< fcmax (3) 

with the normalization constant A = ^2k~ 7 . In the limit of large fc max , the degree distribution ^ is normalizable 
provided 7 > 1, and the normalization constant is then given by 

A=Y, k ~~'~~ (4) 

fe=fc ~ 

The mean vertex degree of the generated degree sequence is 

(fc) = V fcP(fc) « k ^^Pp^ . (5) 
W ^ W (7-2)(l-(fc /fc max r- 1 ) 



k— kg 



The mean vertex degree (fc) attains a finite limit for large fc max provided 7 > 2. It behaves as (fc) ss fco for large 
positive 7, corresponding to a random network with uniform vertex degree fc = fco. On the other hand, the expression 
([5]) also implies 



, ln(fc r „ax/fco) , ,„s 

1 - (fco/fcmax) 



which diverges as lnfc ma x for large fc n 



B. Multi- networks and simple- networks 



After one degree sequence {fci, fc2, . . . , fcj\r} has been generated, we attach fcj half-edges to vertex i. Then we 
repeatedly crosslink two half-edges into a complete edge of the network, until all half-edges have been used up. In this 
way, an initial network with the specified degree sequence is created which is then further randomized by performing a 
certain number of edge switching moves [l4| . We use two different ways to implement the crosslinking process and the 
subsequent switching process which lead to two different ensembles of networks, multi-networks and simple-networks: 

(A) Multi-networks: During the initial crosslinking process, two half-edges are randomly chosen from the set of 
remaining half-edges and are then crosslinked into an edge of the network. During the subsequent randomization or 
edge switching process, two edges (ij) and (kl) are randomly chosen from the set of all edges of the network, and they 
are replaced by two new edges (ik) and ( jl)- A network that has been generated in this way will, in general, contain 
both self-connections and multiple edges [la |. 

(B) Simple-networks: During the initial crosslinking process, we again randomly choose two half-edges from the set 
of remaining half-edges but crosslink them only into a tentative edge. This tentative edge is only kept if it provides 
a connection between two different vertices that have not been connected before. Otherwise, the tentative edge is 
discarded. In this way, we discard all tentative edges that represent self-connections or multiple edges. During the 
subsequent randomization or edge switching process, we proceed in an analogous manner: (i) we randomly choose 
two edges (ij) and (kl) of the network; (ii) we create two new tentative edges (ik) and (jl); and (hi) we keep these 
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tentative edges only if they do not represent self-connections or multiple edges. Otherwise, we reject this move and 
keep the old edges (ij) and (kl). The networks generated in this way are simple in the sense that they contain no 
self-connections and no multiple edges. 

In principle, the network graphs generated by these two procedures could have several disconnected components. 
In such a situation, the activity pattern would consist of several subpatterns that are disconnected and, thus, evolve 
independently of each other. The number and size of these components depends primarily on the scaling exponent 7 
and the minimal vertex degree fco- In the following, we will discuss ensembles of networks with 2 < 7 < 3 and fco > 5 
. For these parameter values, all multi- and simple-networks that we generated by the procedures (A) and (B) were 
found to consist of only a single component. Each of these networks is then characterized by a single activity pattern 
in which all N vertices participate. 

So far, we have not distinguished between a network and its most intuitive representation, the corresponding graph 
with vertices i and (undirected) edges (ij). Another general representation is provided by the adjacency matrix I of 
the network. Each element of this N x N matrix counts the number of edges, m(i,j), between vertex i and vertex 
j, i-e., 

I ij =m(i ) j)>0. (7) 

For an undirected graph as considered here, the adjacency matrix is symmetric and Iji = 1^. Furthermore, a simple- 
network without self-connections and multiple edges is characterized by la — and < Jy < 1 for all vertex pairs 



C. Local majority-rule dynamics 

We now place a binary or Ising-like spin er s ; = ±1 on each vertex i of the network. Alternatively, we can use the 
activity variable a[ = (<7j + 1)/2 which assumes the values a' i = 1 and corresponding to an active and inactive vertex 
i, respectively. Thus, the spin configuration {cr(t)} = {<7i(i), <72(i), . . . , <tjv(*)} represents the activity pattern on the 
network at time t. 

For the dynamics considered here, the time evolution of the spin or activity pattern is governed by the local 
time-dependent fields 

h i (t)=^I ij (r j +2Iiia i . (8) 

Because of the adjacency matrix I, the sum contains contributions from all vertices j that are connected to vertex i, 
and this contribution is weighted by the multiplicity Jy = m(i,j) which counts the number of edges between i and j. 
Therefore, the sign of the local field hi is positive and negative if the weighted majority of the nearest neighbor spins 
is positive or negative, respectively. For multi-networks, the nearest neighbors are weighted with the corresponding 
edge multiplicity. For simple-networks, all nearest neighbors have the same multiplicity equal to one, and the absence 
of self-connections implies la = for all vertices i. 

In the parallel or synchronous version of the local majority-rule dynamics, the discrete time t is increased by At = 1, 
and the spin or activity pattern at time t is updated simultaneously on all vertices i using the rule 

o-i(t + l) = +1 if hi(t) > , 

= -1 if hi(t) < . (9) 

In the random sequential or asynchronous version of the local majority-rule dynamics, time t is increased by At = 1/iV", 
a vertex i is randomly chosen, and the spin value o~i on this vertex is updated according to 

Ui(t + l/N) = +1 if h,{t) > , 

= -1 if hi(t) < . (10) 

while the spin values for all the other vertices remain unchanged during this update. In this way, the update of the 
whole network from time t to time t + 1 is divided up into N successive substeps. 

If the local field hi(t) — corresponding to an equal number of up and down spins on the nearest neigbor vertices, 
we choose ai(t + At) = +1 or —1 with equal probability both for the parallel update described by ([9]) and for the 
random sequential update as given by (|10[) . These local majority rules, which are equivalent to Glauber dynamics 
[l6l.[l7T| at zero temperature, have two fixed points corresponding to the two completely ordered patterns with {a(t)} = 
{a (-) } = , _i } an d { a (t)} = {a^} = {+1, +1, . . . , +1} 
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D. Average properties of activity patterns 



In general, the analysis of activity patterns on scale-free networks involves several types of averages. First, we 
consider an ensemble of networks which is characterized by the degree distribution P{k). Second, we are interested 
in typical trajectories for the time evolution of the spin or activity pattern and, thus, consider an average over an 
ensemble of different initial patterns. Third, in order to characterize the global behavior of the patterns, we perform 
spatial averages, i.e., averages over the vertices i. 

The dynamics of the spin located on vertex i is governed by the local field hi (t) as defined in (jHJ which depends on 
the ki neighboring spins. Therefore, it will be useful to divide the spatial average over all vertices up into averages 
over those vertices that have the same vertex degree k. The simplest average property is the expectation value (crj(t)} 
which may be divided up according to 

in®) = Yl p (k)(^{t)) k = j2 p ( k )i 2 ik(t) i] (ii) 

k k 

where (<Ji(t)) k represents the average over all vertices with degree k and q k (t) is the probability to find a fc-vertex in 
the spin-up state. 

The expectation value ((Ti(t)) may also be viewed as an overlap function. In general, the overlap of the actual 
pattern {a(t)} with an arbitrary reference pattern {a} is given by 

A({<r(t)M*})=i£ (12) 

i 

Thus, the expectation value (<jj(t)) measures the overlap of the actual pattern with the completely ordered pattern 
{o-W} = {+l,+l,...,+l} and 

(a,(i)) = A(Mi)},{aW})EA(i). (13) 

The average local field (hi(t)) k acting on a fc-vertex depends on the expectation value (<r^(t))fe_ ne where the subscript 
fc-ne indicates an average over all k neighbors of the fc-vertex. The latter expectation value can be expressed in terms 
of the rm-spin up probability Q k (t) that a randomly chosen neighbor of a fc-vertex is in the spin-up state. One then 
has 

{hi(t)) k = fc(<T i (t)) fe _ ne = k[2Q k (t) - 1]. (14) 
The probabilities q k (t) and Q k (t) are not independent but related via 

Q k (t) =J2P(k'\k)q k > (15) 

k' 

with the conditional probability P(k'\k) that a randomly chosen neighbor of a fc-vertex is a fc'-vertex. In the following, 
the quantity Q k will be called the nn-spin up probability where the prefix 'nn' stands for 'nearest neighbour'. 

In the multi-networks as defined in Sect. Ill Bl above, there are no vertex degree correlations. Following a randomly 
chosen edge of a vertex with degree fc, one will arrive at a vertex with degree fc'. In such uncorrelated random 
networks, the conditional probability P(k'\k) is independent of the vertex degree fc, and one has 

P(k'\k) = k'P(k')/(k) . (16) 

In such a situation, the relation as given by (|15p simplifies and becomes 

Qk(i) = 1 E^-9k(t) = Q(t). (17) 

Therefore, for networks without vertex degree correlations, the nn-spin up probability Q k (t) is independent of fc and 
Qk(t) = Q{t) The latter probability satisfies the relation 

2Q(t) - 1 = E ^kY^^ k ^j^ ^ 



where we used the identity 2q k (i) — 1 = (<Ji(t)) k . Thus, the fc-independent probability Q(t) is directly related to the 
weighted expectation value (fci<7j) which puts more weight on vertices with larger degree fc. 
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During the generation of a simple- network, compare Sect. Ill Bt the elimination of self-connections and multiple 
edges leads to correlations in the vertex deg rees of neighboring vertices. Such correlations become significant for 
scale-free networks with 7 < 3 flillill. fl9L l20l] Therefore, the relation (fT6|) represents an approximation for scale-free 
random simple-networks with 7 < 3. In these latter networks, the average vertex degree of the neighbors of a fc-vertex, 
(k')k-ne = Ylk' k'P(k'\k), is a decreasing function of k. 



III. MEAN-FIELD ANALYSIS 



In the mean-field analysis, we use two simplifications. First, we assume that there are no correlations between the 
vertex degrees. Thus, we use the relationship P(k'\k) = k'P(k')/{k) as in p6[) . This implies that the nn-spin up 
probability Q k (t) is independent of k and identical to Q(t) = 5 [1 + (ki<Ji) / (k)] . As previously mentioned, this identity 
is valid for the multi-networks but represents an approximation for the simple-networks. 

Second, we express the probability P(hi(t) > 0) for the local field hi(t) to be positive in terms of the probability 
Q(t). In order to do so, we sum over all spin configurations of the neighboring vertices that correspond to a majority 
of up spins. At this point, we assume that multi-edges are rare and that all ki neighboring spins are distinct. 
This assumption applies to the simple- networks but represents an approximation for the multi- networks. Using this 
assumption, we obtain for all vertices i with vertex degree ki that 

k 

V(h l (t)>0) = B{k,m)[Q{t)] m [\-Q{t)] k - m with k = h (19) 

m— mi 

where the summation over m starts with 



mi = h/2 for even ki 

= (ki + l)/2 for odd h , 



(20) 



B{k t m)= —^— =(i ] ,21. 



and 

m\(k — m)\ \ 771 

denotes the binomial coefficient. 

If we now update the spin ai(t) using the local majority rule as introduced above, we obtain Oi(t + At) = +1 with 
probability 

v\ + \t + At) = V(hi(t) > 0) + \VQn(t) = 0) (22) 

and <7i(f + At) = -1 with probability 1 - V- +) (t). If the vertex de gree ki is odd, one cannot have the same number of 
neighboring up and down spins which implies that the probability V(hi(t) = 0) vanishes for all t. If the vertex degree 
ki is even, we obtain 

V(hi(t) = 0) = B(k, k/2) [Q(t)} k/2 [1 - Q(t)} k/2 with k = h (23) 
where ki distinct neighboring spins have been assumed as before. 



A. Parallel or synchronous updating 

First, we apply the mean-field analysis just described to parallel or synchronous updating with At = 1 as defined 
by ©. Inspection of the relations (fH)]) and (|23p for the probabilities V(hi(t) > 0) and V(hi(t) = 0) shows that, within 
mean-field theory, these probabilities are identical for all vertices with the same vertex degree ki = k. Since these two 
probabilities determine the probability V[ + \t + At) via (f2"2")l . the latter probability is also identical for all vertices i 
with the same ki = k. Thus, mean field theory implies that 

v\ +) (t + At) = q k (t + At) with k ee k, (24) 

where the up spin probability qk has been defined in ((lip . After rearranging the summation over m, one obtains the 
iteration equation 

q k (t + At) = £'(1 - ^S mik/2 ) B(k, m) Q m (t)(l - Q{t)f- m (25) 

m 
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evolution step 

FIG. 1: Histogram of decay times td for parallel local majority-rule dynamics on a uncorrelated random mult i- network. The 
decay time is measured in units of iteration steps. The four sets of data are obtained for two random scale-free networks with 
7 = 2.25, fco = 5 (triangles) and two random scale-free networks with 7 = 2.75, ko — 9 (squares). All four networks have 
the same vertex number TV = 2 18 and almost the same mean vertex degree (k) ~ 20. For each data set, 2,000 individual 
trajectories with the initial condition of A = and Q = 1/2 are simulated. Each trajectory is tracked until the shifted nn-spin 
up probability \Q(t) — 1/2 1 exceeds 1/4 for the first time (the main figure) or the average spin value |A(£)| exceeds 1/2 for the 
first time (the inset). 

where the prime indicates that the summation now runs over all integer m with k/2 < m < k, and S is the Kronecker 
symbol. The iteration equation (j2"5")l is valid both for even and for odd values of k. 

If we insert the spin up probability q k {t + At) as given by ([25]) with At = 1 into the relation (fl"7"|) for time t+1, we 
obtain the evolution equation 

Q(t+l) = *(Q(t)) (26) 
for the nn-spin up probability Q(t) where the evolution function ^(Q) is defined by 

*(Q) = E^ 1 - \ S m,k/2) k P(k)B(k, m) Q m (l - Q) k - m /(k) . (27) 

km 

The evolution equation (j26|) has two stable fixed points at Q = and Q = 1, and an unstable one at Q = 1/2. 
The fixed points with Q = and Q = 1 correspond to the all-spin-down and all-spin-up pattern, respectively. 
The unstable fixed point with Q = 1/2 represents the phase boundary between these two ordered patterns; the 
corresponding boundary patterns are characterized by probabilities qu which satisfy 

]T kP(k)q k = (k)/2 . (28) 

k 

Since Q = 1/2 represents an unstable fixed point for the time evolution of the nn-spin up probability Q(t), a natural 
question to ask is the typical time needed for the system to escape from Q = 1/2. Figure Q] displays the histogram of 
the decay times td needed for the system to evolve from Q(to) — 1/2 at time to to \Q(to + td) — 1/2 1 > 1/4 at time 
to + td- For the four scale- free random networks with mean vertex degree (k) ~ 20, we find that the typical decay 
time is positively correlated with the scaling exponent 7. The most probable decay time, for example, is td >m p = 6 
for 7 = 2.25 but td : mp = 9 for 7 = 2.75. Figure shows the mean value of Q(t) and A(t) as a function of time t 
for the same four different random networks. As the scaling exponent 7 becomes smaller, the system approaches the 
completely ordered patterns more quickly. 

To understand this difference in decay times, we now estimate the mean decay time according to our mean-field 
theory. For this purpose, we define the order parameter 



y = Q -1/2 



(29) 
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FIG. 2: Time evolution of (A) the nn-spin up probability Q(t) and (B) the average spin value A(t) for parallel local majority- 
rule dynamics on an uncorrelated random multi-network of size N = 2 18 and mean vertex degree (k) ~ 20. Time is measured 
in units of iteration steps. The four sets of data correspond to the same four scale-free random networks as in Fig. Q] 



The order parameter y vanishes for all the boundary patterns satisfying Eq. (|28|) . In the vicinity of y = 0, the 
evolution of y is governed by the following linearized evolution equation 

y(t + l) = *'(l/2)y(t) , (30) 

where 1 3/'(l/2) = d 1 ^ /d<5|g =1 / 2 is expressed as 

*'(l/2) = E E ^B(k,m)2'- k (2m~k) 

k m>k/2 ^ ' 

^ (2m + l) 2 P(2m + 1) „,„ , ^ (2m) 2 P(2m) „. 

= > " ,\ n ^— L B{2m,m) + > ^ — -B(2m, m) . (31) 

(k)2 2m y ' ^ (k)2 2m K 1 y ' 

m=0 v ' m=l v ' 

The binomial coefficient in Eq. (|31 [) can be estimated by Stirling's formula which leads to 

B (2m, m) = « ^Im" 1 / 2 . (32) 

m\m\ \l 7r 
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If this relation is inserted into Eq. (|31j) , we obtain 



*XL/2)«^5>ip(fc). (33) 



In the limit of large network size N, Eq. (|33[) is well approximated by 



In the limiting case of 7 = 5/2 and 7 = 2, the expressions for \&'(l/2) is, respectively, 

, w , A'/'iyw^i! for 2 . (36) 

7r m(fc max /fc ) 

Finally, using the relation that fc max = fco-^ 1 ^ 7-1 '' as given by Eq. ([2|) for sufficiently large network size N, we obtain 
the following asymptotic behavior for \P'(l/2) 



*'(l/2) w 2\/2fco/7rA rl/2 /ln(A r ) for 7 = 2, 



J2k /TT^ iV^TT for 2 < 7 < 5/2 

3-7 

^2fe /7rln(iV) for 7 = 5/2, 



« ^2k^r- g for 7 > 5/2 . (37) 

7-2 

From Eq. (|37[) we know that W'(l/2) is independent of network size iV for 7 > 5/2 while it increases with TV for 
7 < 5/2. Since the slope ^'(1/2) determines the evolution of y(t) for small y, we expect to see a qualitative change 
at 7 = 5/2. 

Iterating the linear evolution equation (|30[) n times from an initial time to up to a final time t\, one obtains the 
time difference 

A '°*='i-'° ln*'(l/2) (38) 

in the limit of small y(to). 

Now consider an initial state of the network at time t — to that corresponds to a strongly disordered pattern with 
order parameter y(t ) = ±1/(2M) = ±l/(k}N where M denotes the total number of edges with 2M = J2i We 
characterize the decay of this strongly disordered patterns by the decay time td, which is the time it takes to reach a 
pattern with an order parameter y* that satisfies |y*| > 1/4. Using Eq. (|38p with t\ = td as well as the asymptotic 
expressions (l3"T|) for 4 ,/ (l/2), the functional dependence of the decay time td on the network size iV is found to be 

t d - ln(iV) for 7 > 5/2 



- ln(A0/lnln(7V) for 7 = 5/2 (39) 

~ 2(7- l)/(5-2 7 ) for 2<7<5/2 

in the limit of large N. Equation (|39p predicts that, for random scale-free networks with 2 < 7 < 5/2, strongly 
disordered patterns always escape from the unstable fixed point after a finite number of iteration steps even in the 
limit of large N. In contrast, for networks with 7 > 5/2, the escape time diverges as ln(iV). This latter behavior also 
applies to Poisson networks and other types of networks with single-peaked vertex degree distributions. The ln(iV) 
scaling in response times was predicted for opinion spreading on social networks [2ll . [22l . |23T | , it was also observed in 
simulations of information spreading on small- world networks [24j |. 

We will check these mean-field predictions in Sec. IIVI and Sec. [V] by extensive computer simulations. 
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B. Random sequential or asynchronous updating 

Next, we apply our mean-field analysis to random sequential or asynchronous updating. In this case, we randomly 
choose single spins. Each single spin update corresponds to the time step At = 1/N which becomes small for large 
N. It is now useful to consider the quantity An(k,t) which represents the change in the number of up spins on all 
£;-vertices during such a single spin update. The average value of this quanitity is given by 

(An{k, t)) = P(k) [1 - q k (t)} q k (t + At) - P(k) q k (t) [1 - q k (t + At)} . (40) 

The total number of up spins on all fc-vertices then changes according to 

NP(k)q k (t + At) = NP(k)q k (t) + (An(k, t)) . (41) 

Using the expansion q k (t + At) w q k (t) + At dq k (t) / dt for large N or small At = 1 /N on the left hand side and 
inserting the expression (f40|) for An(k, t)) on the right hand side, we obtain 

^p- = -q k (t)+q k (t + At). (42) 

In addition, the up spin probability q k (t + At) is still given by (|25| which leads to the continous-time evolution 
equations 



dq k {t) 
dt 



-q k {t) 



■ £'a - ~<w/2) B(k, m ) [Q(t)r [i - Q(t)j k ~ 



(43) 



for the spin up probabilities q k (t) and 



dQ(t) 
dt 



-Q(t) + *(Q(t)) 



(44) 



for the nn-spin up probability Q{t) where ^(Q) is still given by (|2T|) . Equation (|44|) has again three fixed points, two 
stable ones at Q — and Q — 1 as well as an unstable one at Q — 1/2. 

As in the scheme with parallel updating, we define a new order parameter y = Q — 1/2, compare (|2T)1) . For an initial 
value y(to) ~ 1/N that represents a strongly disordered initial pattern, the order parameter y(t) behaves as 



y(ti)«2/(to) e (,p ' (1/2) - 1)(tl - to) 



which implies the time difference 



Aioi = t\ — to 



Inyjh) - lay (t ) 
*'(l/2) - 1 



(45) 



(46) 



We again characterize the decay of this strongly disordered patterns by the decay time t\ = td, which is the time it 
takes to reach a pattern with an order parameter j/* that satisfies > 1/4. Using the initial value y(to) ~ 1/N, we 
now obtain from (|4"6")l that the typical decay time td scales as 



t d - ln(AT) for 7 > 5/2 

- iV° for 7 = 5/2 

- iV° for 2 < 7 < 5/2 



(47) 



in the limit of large network size N. Equation (|47p is qualitatively very similar to the scaling relation (|39p for 
the parallel updating scheme. A transition in dynamic behavior is therefore also predicted for random sequential 
local majority-rule dynamics. For uncorrelated scale-free random networks with 7 > 5/2, Eq. (I4T[) again predicts a 
logarithmic scaling of the typical decay time td with network size N. When the scaling exponent 7 < 5/2, on the 
other hand, the typical decay time is independent of N. The case 7 = 5/2 is special since the mean-field analysis 
predicts that td is independent of N for random sequential updating but grows logarithmically with N for parallel 
updating. 
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IV. SIMULATION RESULTS FOR RANDOM MULTI-NETWORKS 

As a complementary approach to our mean-field analysis in Sec. IIII1 in this and the following section, we perform 
local majority-rule dynamics on individual random scale-free networks. In this section, the substrate networks are 
generated by rule A of Sec. Ill Bl These multi- networks are completely random and uncorrelated, and typically contain 
both self-connections and multiple edges. 

After a network is constructed with given parameters N, 7, and fc , a random initial spin pattern {cj(0)} is assigned 
to vertices of the network. The system then evolves according to Eq. (|9|) for parallel updating and according to Eq. (fTO]) 
for random sequential updating. Each resulting trajectory is monitored and the values of A(t) and Q(t) as defined in 
Eq. (p~3|) and Eq. (fl"8|) , respectively, are recorded at each time point t. The initial spin patterns are chosen such that 
the average spin value A and the nn-spin up probability Q have the initial values 

A(0) ee and Q(0) ee ~ , (48) 

i.e., these patterns are disordered both with respect to the average spin value and with respect to the nn-spin up 
probability. We track each trajectory until the two conditions |A(t)| > 1/2 and \Q(t) — 1/2] > 1/4 are both satisfied. 
For each random network, 2,000 such trajectories are simulated and analyzed in order to estimate the median decay 
time. 

In our previous study we used parallel or synchronous updating in order to generate the time evolution of 
the activity patterns. In the present study, we use both parallel updating and random sequential or asynchronous 
updating and check the robustness of our qualitative conclusions in Ref . [9j . For parallel updating, our simulational 
results are summarized in Fig. [3J for random sequential in Fig. In these figures, we plot the median decay time, 
td.m, as a function of the network size or vertex number N. By definition, the median decay time td,m splits the decay 
time histogram up into two parts of equal size, i.e., the probability to observe a decay time t& with td < td,m is equal 
to the probability to observe one with td > td, m - In Fig. [3Ja) and Fig. Ufa), we display the median decay time needed 
for the system to reach a pattern characterized by \Q(t) — Q(0)\ > 1/4 from an initial strongly disordered pattern, 
which satisfies Eq. ([4"5|) . Likewise, in Fig.[3fb) and Fig. 0|b), we show the median decay time for the system to attain 
a pattern characterized by |A(i)| > 1/2 starting again from an initially disordered pattern satisfying Eq. (j48|) . 

The data for parallel updating of multi-networks as shown in Fig. [3J do not exhibit a clear distinction between 
networks with 7 > 5/2 and those with 7 < 5/2. In contrast, the data for random sequential updating of multi- 
networks as shown in Fig. 2] exhibit such a distinction, at least for 7 = 2.25 and 7 = 2.6. For scaling exponent 
7 > 2.6, the median decay times td. m increases with network size N according to td.m ~ (InN) 11 , where the exponent 
n appears to be slightly larger than 1. Our mean field theory predicts n = 1. For 7 = 2.25, which is smaller than 
but not close to 7 = 5/2, the median decay time td, m is found to be independent of network size N, see Fig. Hta) and 
(b), in agreement with our mean-field prediction. However, for 7 = 2.4, which is smaller than but close to 7 = 5/2, 
inspection of Fig. f?] indicates that the median decay time increases slowly with network size N. This observation 
disagrees with our mean field prediction. 

V. SIMULATION RESULTS FOR RANDOM SIMPLE-NETWORKS 

The random multi-networks discussed in the previous Sec. IIVI contain self-connections and multiple edges between 
the same pair of vertices. Such connections are absent in many real networks. Thus, we will now consider the temporal 
evolution of activity patterns on random simple- networks without self-connections and multiple edges. As previously 
mentioned, such networks exhibit some vertex degree correlations. 

We use rule B as described in Sec. Ill Bl in order to generate an ensemble of scale-free random simple-networks. Each 
vertex of the network is occupied by a binary variable or spin which evolves again according to local majority rule 
dynamics. We use both parallel and random sequential updating starting from random initial conditions as specified 
by Eq. PB")) . The degree sequences of the generated networks are the same as those used in the preceding section. 
Therefore, if the results of this subsection are different from those of Sec. IIVI the differences must be related to the 
correlations in the random simple- networks. Our simulational results are summarized in Fig. [5] and Fig. [6] for parallel 
and random sequential updating, respectively. 

In Fig. [DJa) and Fig. [SJa), we display the median decay time td, m needed for the network to reach an activity 
pattern that is characterized by a nn-spin up probability Q(t) that satisfies \Q(t) — Q(0)| > 1/4 when the initial 
pattern is characterized by the relation (|48f . Likewise, in Fig. [3(b) and Fig. [6jb), we show the median decay time 
for the network to reach a pattern with average spin value |A(t)| > 1/2 starting again from an initial pattern which 
satisfies 
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FIG. 3: Median decay time td.m as a function of network size N for random multi-networks and parallel or synchronous 
updating. Each data point is obtained by performing simulations on 100 multi-networks, (a) Median decay time needed to 
reach a partially ordered pattern characterized by \Q(t) — 1/2 > 1/4| for the first time; and (b) Median decay time needed to 
reach a partially ordered pattern with \A(t) > 1/2| for the first time. 



For scaling exponent 7 > 5/2, the median decay time td.m increases with network size N as td,m ~ {h\N) n with 
a growth exponent 77 that again appears to be slightly larger than the mean field value 77 = 1. The same behavior 
was observed in the preceding section for random multi-networks. For 7 = 2.25, which is smaller than but not close 
to 7 — 5/2, the median decay times are essentially independent of the network size N. The latter behavior was 
also found for random sequential updating of multi-networks. For 7 = 2.4, i.e., smaller than but close to 7 = 5/2, 
on the other hand, both Fig. [5] and Fig. [5] demonstrate that the median decay time first increases slowly and then 
saturates for increasing network size N. In other words, the function td, m — id,m(hi./V) is now convex downwards. 
This situation is remarkably different from what was found in random multi- networks, see Fig. [3] and Fig. [H for which 
the function td, m = ^d,m(ln7V) is convex upwards over the whole range of accessible iV- values. Therefore, for random 
simple-networks, we conclude that the median decay time td,m becomes independent of network size N in the limit 
of large N if the scaling exponent 7 of the scale- free degree distribution satisfies 7 < 5/2 as predicted by mean field 
theory. 
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FIG. 4: Median decay time td, m as a function of network size N for random multi-networks and random sequential or 
asynchronous updating. Each data point is obtained by performing simulations on the same set of 100 random multi-networks 
as in Fig. [3] (a) Median decay time needed for \Q(t) — 1/2| to exceed 1/4 for the first time, (b) Median decay time needed for 
[A(t)| to exceed 1/2 for the first time. 



VI. EFFECTIVE SCALING EXPONENT FOR MULTI-NETWORKS 

Multi- network typically contain self-connections and multiple edges. As shown in Fig. [2a), the fraction of edges 
that represent multiple edges is found to vary between about 10 _1 and 10~ 3 depending on the number N of vertices 
and the scaling exponent 7 of the scale-free degree distribution. Furthermore, the fraction of edges that represent 
self-connections varies between 10~ 2 and 10 -5 , see Fig.[7]Jb). Both fractions decrease with increasing network size N 
and increase with decreasing scaling exponent 7. This behavior can be understood from the following considerations. 

In a random multi-network, the probability that an edge is a self-connection of vertex i is equal to \k%/^2,j kj) = 
fe|/(4M 2 ), where fcj is the degree of vertex i and M is the total number of edges as before. The average number 
of self-connections of a certain vertex i with degree ki is then given by kf/AM. Therefore, the total number of 
self-connections is estimated to be 



N , 2 ,2 

Mself = y A. = Y NP(k)— 

4 M V ) 4M 

i=l k 



(49) 
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FIG. 5: Median decay time as a function of network size N for random simple-networks and parallel or synchronous updating. 
Each data point is obtained by performing simulations for an ensemble of 100 networks. Each simulation run starts from an 
initial spin or activity pattern characterized by relation (|48|) . (a) Median decay time needed to reach a spin pattern for which 
the rm-spin up probability Q(t) satisfies \Q(t) — 1/2 1 > 1/4 for the first time; and (b) Median decay time needed to reach a 
spin pattern for which the average spin value A(i) exceeds 1/2 for the first time. 



5(7-1) 7V(3~7)/(7-l) _ I 

(50) 



2(fc)(3-7) l-l/N 



for a scale- free network with scaling exponent 7. This relation shows that, for 7 > 3, the total number of self-connetions 
is of order unity. In contrast, for scale- free networks with 2 < 7 < 3, the total number M se if of self-connections scales 
with network size ./V as M se i£ ~ jV"( 3 — tO/Oy-i) f or large N. Therefore, the fraction of self-connections decays as 
M sci {/M ~ AT(4-27)/(7-l) wit h increasing network size N. 

Likewise, in a random multi-network, the probability that an edge is formed between a certain vertex i with degree 
ki and another vertex j with degree kj is given by 



T,ihT,ih 2M 2 ' 

Using this probabilility, one may derive an approximate expression for the total number M mu i t of multiple edges. The 
formula is a little bit more complex than Eq. (|50[) so we do not write down the explicit formula here. The average 



15 




Number of Vertices 




Number of Vertices 



FIG. 6: Median decay time as a function of vertex size N for random simple-networks and random sequential or asychronous 
updating. Each data point is obtained by performing simulations for the same ensemble of 100 simple- networks as in Fig. [S] 
(a) Median decay time needed for \Q(t) — 1/2| to exceed 1/4 for the first time; and (b) Median decay time needed for \A(i)\ to 
exceed 1/2 for the first time. 

number of multiple edges is also found to be of order unity for 7 > 3 and to increase with network size N as a 
power-law for 2 < 7 < 3. This is consistent with the data shown in Fig. [7{a). 

Furthermore, we find that the removal of all self-connections and multiple edges from a scale-free multi-network 
leads to a simple-network that is again scale free but with the modified vertex degree distribution 

P cB (k) ~ fc-w with 7off = 7cff ( 7 ,7V). (52) 

In Eq. (I52|) . k is the effective degree of a vertex, i.e., the number of connections of the vertex after all its self- 
connections are removed and all its multiple edges are reduced to a single edge. The scaling exponent 7 c fr can be 
obtained by calculating the cumulative distribution function of the effective degree k [25| . The functional dependence 
of the effective scaling exponent j e g on the scaling exponent 7 of the original multi-network and on the network size 
N is displayed in Fig. [51 Inspection of this figure shows that the effective scaling exponent satisfies j e g > 7 and 
decreases towards 7 with increasing network size N. For 7 = 2.9, 2.75, and 2.6, the data strongly indicate that the 
effective exponent 7o ff becomes asymptotically equal to 7 for large N. We expect that the same behavior applies to 
the multi-networks with 7 < 5/2 but this remains to be shown. 

Now, let us focus on the case 7 = 2.4 for which we found some qualitative differences between multi- and simple- 
networks. As shown in Fig. [5J the effective scaling exponent is found to satisfy 7 c fr <; 2.5 up to N = 2 17 for 
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FIG. 7: Fraction of (a) multiple edges and (b) self-connections in a random scale-free multi-network. Each data point is an 
average over the same ensemble of 100 random networks as used in the simulations of the preceding sections. 



multi-networks with 7 = 2.4. Thus, these multi-networks lead to simple-networks with ~/ c g > 5/2 for almost all values 
of N that are accessible to the simulations. In this way, we obtain a rather intuitive explanation for our difficulty to 
confirm the mean field predictions for multi-networks with 7 = 2.4. 

As far as the network's topology is concerned, both self-connections and multiple edges can be regarded as redundant. 
However, these self-connections and multiple edges have very significant effects for the dynamics of activity patterns 
of these networks. Let us consider the following simple example. Suppose there are two high-degree vertices i and j 
with initial spin state 0^ = 1 and aj = — 1. Each of these two vertices is taken to have many self-connections, and 
there are many edges between them. The self-connections tend to stabilize the current spin state of each vertex, while 
the edges between i and j tend to align the two spins. The frustration caused by the competition of these two effects 
can lead to an increase in the relaxation time. More generally, in a scale-free multiple network with 7 < 3, there 
exists a densly connected core of high-degree vertices. Each vertex of this core has many self-connections (which tend 
to stabilize its current spin state) and is connected by multiple edges to many vertices in this core (which tend to 
align the spins on neighboring vertices). Starting from a random initial spin configuration, spin state frustrations may 
easily build up within such a core. Such frustrations can be 'annealed' by external influences as provided, e.g., by the 
interactions with vertices outside the core, but for scale-free multi-networks with 7 ~ 5/2, this annealing process may 
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FIG. 8: Effective scaling exponent 7 e ff for random simple-networks that have been obtained by removal of all multiple edges and 
self-connections from an ensemble of random multi-networks. Each data point is obtained by merging all the 100 vertex degree 
sequences corresponding to the 100 multi-networks used in the simulation. The degree distributions of these multi-networks 
are characterized by the parameter values 7 = 2.25, fco = 5 (triangles left), 7 = 2.4, fco = 6 (triangles up), 7 = 2.6, ko = 8 
(diamonds), 7 = 2.75, ko = 9 (squares), and 7 = 2.9, ko = 10 (circles). 



take a relatively long time, since the fraction of 'redundant' edges is high and the effective scaling exponent is larger 
than 5/2. 

In our simulation, we have studied only the dynamic properties of random scale-free networks. In general, the vertex 
degrees of neighboring vertices may be correlated. In the case of simple networks, these correlations are caused by 
prohibition of self-connections and multiple edges [HI, [IM 0) H3] i m the case of multiple networks, these correlations 
exist between the effective vertex degrees of neighboring vertices. Such correlations of vertex degrees may also have 
some influence on the majority-rule dynamics. In order to study the influence of vertex degree correlations on the 
dynamic network processes in a quantitative manner, one may generate ensembles of random networks with specified 
vertex degree and specified vertex correlation patterns (see, e.g., In fact, the co-evolution of correlations in the 

network structure and network dynamics represents a rather interesting topic for future studies. 



VII. CONCLUSION AND DISCUSSION 



We have studied the time evolution of activity patterns on scale-free random networks which are characterized by 
the degree distribution P(k) ~ 1/fc 7 for ko < k < k max . We constructed two different ensembles of such networks as 
explained in Section [II Bl (A) multi- networks with self-connections and multiple edges as generated by the configura- 
tion method and (B) simple-networks without any self-connections and multiple edges as generated by a combination 
of the configuration method and an edge switching or reshuffling algorithm. We focussed on networks with minimal 
vertex degree fco > 5 for which all network graphs were found to consist of only a single component. 

On each vertex of these networks, we place a binary variable or Ising-like spin cr, = ±1. For a given network with 
N vertices, the activity pattern at time t is described by the spin configuration {a(t)} = {fi(i), <J 2 (t), . . . , <7jv(t)}- 
The time evolution of this pattern is govened by local majority dynamics, which represents a Markov process in 
pattern space and is equivalent to Glauber dynamics at zero temperature. We used two different updating schemes 
as explained in Section III CI (i) parallel or synchronous updating as defined by ([9]) and (ii) random sequential or 
asynchronous updating as in pTJj) . 

We focussed on the relaxation or decay of initial activity patterns that are strongly disordered both with respect 
to the average spin value A = (a) as given by (|13[) and with respect to the nri-spin up probability Q as defined in 
(fTS"]) (where nn stands for 'nearest neighbor'). Indeed, these initial patterns are chosen to satisfy A = and Q = 1/2 
as in (|48p . The relaxation process is measured by the decay time td it takes to reach a pattern with |A| > 1/2 and/or 
I Q — 1/2 1 > 1/4. This decay time is governed by a single peak distribution from which we determined the median 
decay time td.m- 
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The mean field theory described in Section IHII predicts that the A-dependence of the decay time is different for 
scaling exponents 7 < 5/2 and 7 > 5/2. For 7 < 5/2, the typical decay time remains finite even in the limit of large 
network size N. In contrast, this time scale increases as In TV with increasing N for 7 > 5/2. In order to check these 
mean field predictions, we have performed four types of numerical simulations corresponding to parallel and random 
sequential updating of multi- and simple-networks. 

The simulation data for parallel updating of multi-networks are shown in Fig. [3l In this case, the median decay 
time is found to increase with network size N up to N = 2 18 for all values of 7. Random sequential updating of the 
same ensemble of multi-networks leads to the data shown in Fig. 2J Inspection of this latter figure shows that the 
median decay time is now essentially independent of A for 7 = 2.25 as predicted by mean field theory. However, 
for 7 = 2.4, this time scale still seems to increase with N in contrast to the mean field predictions. This apparent 
increase can be understood if one defines an effective scaling exponent j e ff for multi-networks as discussed in Section 
IVII As shown in Fig. [5J this effective scaling exponent decreases monotonically with increasing network size ./V and 
satisfies j e g > 7. In particular, for multi-networks with 7 = 2.4, we find j e g <; 5/2 up to A = 2 17 . 

The simulation data for parallel and random sequential updating of simple- networks are shown in Fig. [5] and Fig. [6j 
respectively. In this case, both updating schemes are in complete agreement with the mean field predictions. Thus, we 
conclude that mean field theory is valid for the ensemble of random simple-networks but is more difficult to confirm 
for the ensemble of random multi-networks because of strong finite size effects as described by the ./V-dependent value 
of the effective scaling exponent 7 e g. 

In the present article, we have analyzed the time evolution of strongly disordered patterns at t — into partially 
ordered patterns characterized by |A| > 1/2 and/or \Q — 1/2| > 1/4 at t = t&. These partially ordered patterns 
further evolve towards completely ordered patterns. If the network has n components, one has 2 K such ordered 
patterns. However, there is always a small but non-zero probability that the local majority rule dynamics does not 
achieve complete order }l2j |. One major reason for this failure is the existence of small network components with certain 
'balanced' shapes that lead to domain boundaries and blinkers [26|, [27|]. The probability to find such components is 
expected to decrease with increasing mean vertex degree (fc) and increasing minimal vertex degree fco- 

Both for d-dimensional regular lattices [28[ and for tree- like networks [23] , the time evolution of activity patterns 
typically leads to metastable states with many domain boundaries and blinkers. In contrast, we did not find such a 
behavior for random scale-free networks with fco > 2 as studied here. Indeed, our simulations show that most of the 
spins are already aligned after about 30 time steps, see Fig. [2] 

Our mean field analysis can also be applied to more complicated dynamical models as we have previously discussed 
in Q. One such extension is provided by finite-connectivity Hopfield models [3(| on scale- free random networks. In 
this case, our mean field theory predicts the storage capacity to grow as N a with network size N where the growth 
exponent a satisfies 1 > a > provided 2 < 7 < 5/2. According to recent experimental studies [H], Hj|, the functional 
networks of the human brain are scale-free with a scaling exponent 7 ~ 2.1. In the latter case, our mean field theory 
leads to a storage capacity that grows as N a with a ~ 0.73, i.e., almost as fast as for the original Hopfield models on 
complete graphs. 

Likewise, we have extended our mean field theory to scale-free networks for which each vertex i contains a Potts- 
like variable that can attain q > 3 values. These dynamic systems exhibit q ordered patterns (in each network 
component) and may evolve towards any of those patterns when they start from a strongly disordered one. For 
these Potts-like systems, we find the same distinction between the relaxation behavior for scale-free networks with 
7 < 5/2 and 7 > 5/2 as in the case of the Ising-like systems studied here. We also considered some hybrid dynamics 
constructed from local majority dynamics and random Boolean dynamics: each spin variable <Ji is updated with 
probability V according to local majority rule dynamics and with probability 1 — V according to random Boolean 
dynamics as in the Kauffman models [33, 34]. As long as V > 0, the relaxation behavior of this more general class of 
models shows the same qualitative change at 7 = 5/2. Finally, we have extended our mean field theory to binary or 
Ising-like variables on directed networks, see The elucidation of these mean field results by appropriate simulation 
studies is highly desirable and remains to be done. 



VIII. APPENDIX: UPPER CUT-OFF FOR VERTEX DEGREE 

In this appendix, we explain the dependence of the maximal degree fcmax on A in more detail. In Ref. (l3j . the 
scaling fcmax ~ A--- 1 was obtained from the requirement that the average number of vertices with degree k > fc ma x 



19 



should be of order one, that is 

oo 

E fc ~ 7 

„ ! (53) 

/c— fco 

It is instructive to rederive the same scaling relation for tax through an alternative way. To do this, we start from 
the scale-free degree distribution Poo(k) which has the same form as that of P(k) in Eq. ([3]) but with k max = oo. The 
distribution Poo(k) is used to generate N random numbers x% with % — 1, 2, . . . , N and xi > ko which correspond to 
the vertex degrees of the N vertices. Since the normalization factor A as given by Eq. (|4]) behaves as A « k Q ~ 7 /(j— 1) 
for large fc max , the random variables Xi are generated according to the probability density 

Poo^^il-l)^- 1 ^ 1 ■ (54) 
The maximal value a; max of the N random numbers Xi is then governed by the probability density 

p0w) = jv(7- 1)^-^(1 -(-h-y- 1 )"- 1 . (55) 

It follows from this latter probability density, which is normalized as well, that a; max has the average value 

W =Nk B(-^-,N) , (56) 

where B(z,N) is the standard beta function (35[. In the limit of large network size N, one has B(z,N) m 
T(z) exp(z)N~ z , which implies 

(x max ) w koN 1 /^ , (57) 

(2) 

i.e., the same ko and N dependence as for fcm ax - The same dependencies are also obtained for the most probable value 
of £ max which corresponds to the maximum of the distribution p(a; max ) and is given by 

x^=k (- + ^-N)^ . (58) 
7 7 

Using the probability density p(a: max ) as given by (58), we obtain for the second moment of a; max the expression 

( x l ax )=Nk 2 B(2^l,N) (59) 
7- 1 

For 7 < 3, (i^jjj) is infinite since one of the arguments of the beta function in Eq. (p)9")) is negative. Thus, the 
fluctuations in x max are unbounded unless we use the natural upper cut-off fcmax = N — 1. 
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